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REMARKS 

The above-noted amendment of claims 1-20, as well as 
the submission of a revised Abstract and marked-up copy and 
clean copy of the Specification, are respectfully submitted 
prior to the initiation of prosecution of this application in 
the U.S. Patent and Trademark Office. 

The above-noted amendments to the claims are 
respectfully submitted in order to more clearly and 
appropriately claim the subject matter which applicant considers 
to constitute his inventive contribution. No new matter is 
included in these amendments. In addition, the revisions to the 
Abstract and Specification are submitted in order to clarify and 
correct the Abstract and Specification and to conform them to 
all of the requirements of U.S. practice. No new matter is 
included in these amendments. 

In view of the above, it is respectfully requested 
that these amendments now be entered, and that prosecution on 
the merits of this application now be initiated. If, however, 
for any reason the Examiner does not believe such action can be 
taken, it is respectfully requested that he telephone 
applicant's attorney at (908) 654-5000 in order to overcome any 
objections which he may have. 
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ABSTRACT OF THE DISCLOSURE 
^he — An additional information inserting apparatus 

according fee the proocnt invention encodes additional 

information signals using two or more kinds of encoding 
methods /encoding formats to generate two or more kinds of 
insertion patterns encoded by respective methods, and 
multiplexes eftd — ouporimpooco — the respective encoded insertion 
patterns to and superimposes them on m ain information signals - 
Thus, the additional information can be detected by decoding 
the encoded insertion patterns in accordance with at least 
cither — one of the encoding methods/encoding formats. Even 
though one set of the additional information is deteriorated 
due to signal processing, attack, or other causes, the 
additional information can be detected correctly using the 
other set of the additional information. Furthermore, even 
though the additional information is important information as 
seen from a view of security, the security information cannot 
be completely erased, revised, or caused to be useless as long 
as all of the encoding methods are not broken, which can 
ensure the protection of fehe— copyright in the main information 
signals . 
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ADDITIONAL INFORMATION INSERTING APPARATUS, 
AND ADDITIONAL INFORMATION INSERTING METHOD 



ToGhnical FiGld BACKGROUND OF THE INVENTION 

The present invention relates , to an additional 
information inserting apparatus and method for inserting 
additional information into main information signals such as 
image signals, music signals, and text signals, and in 
particular, to an additional information inserting apparatus 
and method for inserting additional information using plural 
kinds of encoding formats which are different from each other 
in the encoding method or encoding key such that insertion 
patterns of the additional information can be detected using 
any format . 

Background Art 

Conventionally, digital information recording apparatuses 
such as a digital VTR and a disc recording/reproducing 
apparatus using a magneto-optical disc as a recording medium 
have been used. Furthermore, a DVD (a digital video disc as a 
trade mark, or a digital versatile disc) to which information 
signals can be recorded has been also used, for example, by 
loading the disk into which — is — loaded — fee a PC (a personal 
computer) . 

Digital data or contents recorded in these digital 
information recording apparatuses can be undesirably copied or 
revised easily, and the copyright of such data or contents is 
confronted with a crisis of being infringed. It is not 
sufficient to reinforce the Copyright Act or other 
regulations , — and^ — ouch — data — e^ — contcnto — should — be — fairly 
used — af=td — uUnfair use thcrcof of the contents or data must be 
excluded -in — view — — information — tcchniquQ — so as to ensure the 
protection of the copyright. 

In order to protect the copyright, it is proposed that 
additional information signals should be superimposed feraon or 
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inserted into main information signals such as digital image 
signals, digital audio signals, and digital data for use in a 
computer. In this case, the additional information is e# 
digital signals. The additional information can be inserted 
into predetermined areas of digital information signals, such 
as header portions each — arranged at each block- baocd of data 
e#in the digital information signals, a TOC (Table of 
Contents) area^ etc. which areas are definitely distinguished 
from areas having the main digital information signals. 

The operation of copying digital information signals can 
be controlled by inserting information for controlling copy ing 
of data or contents (copy once or never copy) , or copyright 
information (copyright representation) into the digital 
information signals . 

In the conventional data communication system, additional 
information is not directly superimposed %eon main digital 
information signals, but indirectly superimposed teon areas 
such as header portions. For this reason, since the 

additional information can be easily deleted or lost 
comparatively by filtering or revising, there arise£ a problem 
that a recording apparatus or a reproducing apparatus cannot 
detect necessary additional information. Especially, in the 

case the additional information is ouch as controlling 

information for preventing unfair copy ing of data or contents, 
or copyright information, the purpose cannot be realized due 
to the absence of the additional information. 

the case the additional information is indirectly 
inserted into the above-described areas, only the m ain 
information signals can be obtained when the digital 
information is converted to analog information, thereby the 
additional information will be lost. This means that, even 
though the — additional information such as — controlling 

information for preventing unfair copy ing of data or contents 
is superimposed — on digital information signals so as to 



2 



suppress unfair copy ing thereof, this will not be effective at 
all after the digital information signals are converted to 
analog information signals. 

In view of the problem en — theof protect ingj eeft — the 
digital data or contents, the technique of "Digital 
Watermarking" or "Data Hiding" is becoming noteworthy as a 
technique for inserting additional information signals into 
main digital information signals, and various methods have 
been proposed. 

5he — Digital Watermarking is a technique for inserting 
additional information into the contents of images or music 
such that the additional information will be scarcely visible 
or audible (refer to "Data Hiding tochniquc — Technique for 
oupporting — Supporting Digital Watermarking (the first and 
second volumes)" (the February 24, 1997 and the March 10, 1997 
issues of Nikkei Electronics magazine) • These articles are 
based on "Techniques for data — Data hiding Hiding " , IBM System 
Journal, vol.35, NOS 3&4, 1996 p313-339.). 

The technique of Digital Watermarking is realized by 
inserting information different from the original information 
into a part of host signals by the use of statistical 
characteristics of the host signals into which the information 
will be inserted. For example, in the case copyright 

information is inserted into the host signals using the 
Digital Watermarking technique, the channel of data 

distribution or the existence of a right of data use is 

examined and copy controlling information is verified by 
making watermarks or the copyright information appear when 
contents are obtained afterward, thereby illegal copy ing can 
be suppressed. 

On the other hand, in the case providers which provide 
digital data or contents insert additional information into 
main information signals by encoding the additional 
information using respective encoding methods or respective 
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keys, the additional information inserted into the main 
information signals cannot be detected when a decoder of an 
information recording and/or a reproducing apparatus such as a 
DVD recorder does not correspond to aft — the encoding method 
employed by the contents providers. As a result, the 
credibility of the copy control-tin^ will be lost. 

Even though original additional information is identical, 
encoded additional information signals or insertion patterns 
to be inserted into the main information signals become 
different in caso when the encoding method is different. Also, 
even though the encoding method as well as the original 

additional information is are identical, the insertion 

patterns generated after encoding become different in caoc when 
key information to be used for encoding is different. 

In this technical field, at present, there coexist plural 
encoding formats. Thus, ift — caoo when a digital information 
recording and/or reproducing apparatus employs a mechanism 
which can detect only the additional information inserted by a 
specified encoding format, the digital information recording 
and/or reproducing apparatus cannot detect the additional 
information inserted by other encoding formats . Accordingly, 
unified copy control ling cannot be performed, and the 
credibility of the protection of data or contents will be 
lost . 

In order to solve the problem, under the recognition of 
the existence (coexistence) of various encoding methods and 
encoding formats, it is desirable that additional information 
is surely detected from main information signals even though 
the additional information conforms to any of the encoding 
methods and encoding formats . 

In Japanese Laying-Open Patent 2000-924 61 (corresponding 
to United States Patent Application Number 09/392050), there 
is disclosed an additional information superimposing method 
capable of extracting additional information which has 
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undergone the spread spectrum and is superimposed to on image 
signals, even though the image signals are those which are 
converted from pictures of different aspect ratios. 

The additional information superimposing method disclosed 
in the aforementioned publication is adapted ^e^f — oolving to 
solve the problem that additional information cannot be 
detected due to the difference of in aspect ratios or picture 
formats, and is not adapted — oolving to solve the problem 
that additional information cannot be detected due to the 
difference e ^in encoding methods or encoding formats. 
Diocloouro of tho Invcntion SUMMARY OF THE INVENTION 

Accordingly, the present invention has an object to 
overcome the above-mentioned drawbacks of the prior art by 
providing an additional information inserting apparatus and 
method for desirably inserting additional information into 
main information signals^ such as image signals or music 
signals_j_ such that the additional information will be scarcely 
visible or audible. 

Furthermore, the present invention provides an additional 
information inserting apparatus and method for desirably 
inserting additional information into main information signals 
so that insertion patterns which are encoded by one of plural 
encoding formats whose encoding methods or encoding keys are 
different from each other can be detected by any of the 
encoding methods or encoding formats . 

The above object can be attained by providing an 
additional information inserting apparatus for superimposing 
additional information teon main information signals, 
comprising means for generating first and second insertion 
signals from the additional information eftd — generating — oocond 
inoortion — oignalo — from — the — additional — information , and means 
for superimposing the rcopoctivo f irst and second insertion 
signals gonoratcd — from — ^he — inoortion — oignal — gcnorating — mcano 
fee — on the main information signals. 
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Also^ the above object can be attained by providing aft 
additional — information — inocrting a method for superimposing 
additional information ^on main information signals, 
comprising the steps of generating first and second insertion 
signals from the additional information — and — gcnorating — oocond 

inoortion signals from fefee additional information , and 

superimposing the roGpoctivo first and second insertion 

signals generated — irR — feke — inoortion — signal gonorating — stop — =fee 
on the main information signals. 

Also t The above object also can be attained by providing 
a recording medium which — has — recorded therein — with signals, 
the signals comprising — being main information signals ; and 
secondary signals — having — superimposed on the main information 
signals, the secondary signals including thereto — additional 

information, v ^ yhorcin first and second insertion signals 

generated from the additional information and oocond inoortion 

oignalo gonoratod from fehe additional information a^?e 

multiplexed together a^d — ouporimpoocd — fee — fe4^e — main — information 
oignalo , 

Also — feThe above object also can be attained by providing 
a method of placing information on a recording mediu m, the 
information including v ^ yhich has rccordod therein oignalo being 

main information signals — having super impoood thereto and 

additional inf ormationT - superimposed on the main information 

signals, v#horoin — fefee recording — medium — is — manufactured — by 

undcrgoing the method comprising the steps of generating first 
and second insertion signals from the additional information 
aftd — generating — second — inoortion — oignalo — from — fefee — additional 
information , superimposing the first and second roopcctivo 
insertion signals gonoratod in the — inoortion oignal generating 
step — feeon the main information signals to form combined 
signals , and recording the combined signals having 
ouporimpoocd thoroto fefee roopoctivc inoortion oignalo 
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gcnoratod — ^ — fel^e — inoortion — oignal — suporimpooing — step — to the 
recording mediuim. 

The additional information inserting apparatus and method 
according to the present invention encode additional 
information signals using two or more kinds of encoding 
methods or encoding formats to generate two or more kinds of 
insertion patterns encoded by respective methods, and perform 
^fche — spatial multiplexing, frequency division multiplexing, 
overwriting multiplexing, or time division multiplexing, and 
superimpose the respective encoded insertion patterns to main 
information signals . 

Thus, the additional information can be detected by 
decoding the encoded insertion patterns in accordance with at 
least oithcr one of the encoding methods or encoding formats . 

When the same additional information is encoded by a 
plurality of encoding means and inserted into the main 
information signals, even though one set of the additional 
information is deteriorated due to signal processing, attack, 
or other causes, the additional information can be detected 
correctly using the other set of the additional information. 

Furthermore, according to the additional information 
inserting apparatus and method of the present invention, when 
a plurality of encoding methods or encoding formats are 
employed, even though the additional information is important 
information as seen from a — v^re wthe viewpoint of security, the 
security information cannot be completely erased, revised, or 
caused to be useless as long as all the encoding methods are 
not broken. Even though the additional information is 
deteriorated due to attack, the additional information can be 
surely transmitted by employing another encoding method or 
encoding format, and multiplexing or multiplexing in -fehe — ^a 
time divisional manner the respective encoded insertion 
patterns and superimposing Qncodod — inoortion — pattornp — fee — them 
on m ain information signals. 
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These objects and other objects, features and advantages 
of the present invention will become more apparent from the 
following detailed description of the preferred embodiments of 
the present invention. 

Briof — DcQcription — — the — Drawingo BRIEF DESCRIPTION OF THE 
DRAWINGS 

FIG. 1 shows a block diagram of an additional information 
inserting apparatus according to the present invention. 

FIG. 2 shows a block diagram of an additional information 
detecting apparatus for detecting additional information from 

image signals having oupcrimpoood thoroto the additional 

information superimposed thereon . 

FIG. 3 shows a block diagram of an additional information 
detecting apparatus for detecting additional information from 

image signals having oupcrimpoood thereto the additional 

information superimposed thereon . 

Fig. 4 shows a circuit diagram of a code modulating 
apparatus which is used in encoding and decoding processing. 

Fig. 5 shows another — example — e# — a block diagram of 
another example of an additional information inserting 
apparatus according to the present invention. 

Boot Mode for Carrying Out the Invontion DETAILED DESCRIPTION 

The additional information inserting apparatus and method 
according to the present invention will further be described 
below concerning the best modes for carrying out the present 
invention with reference to the accompanying drawings. 

In the following explanation, the present invention will 
be explained by employing an embodimentT- in which additional 
information signals are encoded using two kinds of encoding 
methods, and the encoded additional information signals are 
multiplexed in %fee — a time divisional manner and superimposed 
^fee — on output image signals supplied from a recording medium 

which has the image signals recorded therein — image 

oignalo . 



8 



Fig.l shows a block diagram of an additional information 
inserting apparatus 100 according to the present invention. 
The additional information inserting apparatus 100 encodes 
additional information signals using two kinds of encoding 
methods to generate two kinds of insertion patterns, ead 
multiplexes the insertion patterns in %fee — a time divisional 

manner and superimposes ^^ie — roopoativc inocrtion — pattorno 

^ ^them on image signals. 

As shown in Fig.l, the additional information inserting 
apparatus 100 includes a recording medium 101 of the image 
signal reproducing side, a data input unit 102, a first 
encoding unit 104, a second encoding unit 105, a time division 
multiplexing unit 106, and a superimposing unit 107. 

Read out signals reproduced from the recording medium 101 
are supplied to the data input unit 102, and are supplied as 
reproduced image signals to the superimposing unit 107. 

The additional information signals to be inserted into 
the image signals are supplied to the first encoding unit 104 
and the second encoding unit 105, respectively. The first 
encoding unit 104 has a key 1, and encodes the additional 
information signals using the key 1 in a first encoding 
method. Then, the first encoding unit 104 supplies the 
encoded signals as first insertion pattern signals to the time 
division multiplexing unit 106. The second encoding unit 105 
has a key 2, and encodes the additional information signals 
using the key 2 in a second encoding method-r which is 
different from that employed at the first encoding unit 104. 
Then, the second encoding unit 105 supplies the encoded 
signals as second insertion pattern signals to the time 
division multiplexing unit 106. The key 1 may be equal to the 
key 2, or may be different from the key 2. 

The time division multiplexing unit 106 multiplexes the 
first insertion pattern signals supplied from the first 
encoding unit 104 and the second insertion pattern signals 
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supplied from the second encoding unit 105 in ^fe-he — a time 
divisional manner, and supplies the multiplexed signals to the 
superimposing unit 107. 

The superimposing unit 107 composites the image signals 
read out from the recording medium and the insertion patterns 
multiplexed in the time divisional manner, and outputs image 
signals having additional information. The output image 
signals will be recorded to a recording medium 151 of the 
image signal recording side which is different from the 
recording medium 101, and which will be used in other 
apparatuses. The output image signals may be transmitted to 
other remote apparatuses via a network 152. 

Fig. 2 shows a block diagram explaining the functional 
configuration of an additional information detecting apparatus 
200 for detecting additional information from the image 
signals having Guporimpoood thereto the additional information 
superimposed thereon . The additional information detecting 
apparatus 200 detects the insertion pattern signals encoded in 
the first encoding method employed by the first encoding unit 
104. 

As shown in Fig. 2, the additional information detecting 
apparatus 2 00 includes a recording medium 201 having stored 
therein the image signals which have additional information, a 
data input unit 202, and a decoding unit 203. 

Read out signals reproduced from the recording medium 201 
are supplied to the data input unit 202, and are supplied as 
reproduced image signals to the decoding unit 203. The 
decoding unit 203 decodes the reproduced image signals. The 
decoding unit 203 is so configured as to perform decoding 
processing corresponding to only the encoding method employed 
by the first encoding unit 104 using the same key 1. The 
decoding unit 2 03 can detect only the additional information 
encoded by only the first encoding unit 104. 
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Fig. 3 shows a block diagram explaining the functional 
configuration of an additional information detecting apparatus 
12 00 for detecting additional information from the image 
signals having oupcrimpoocd thereto the additional information 
superimposed thereon . The additional information detecting 
apparatus 1200 detects the insertion pattern signals encoded 
in the second encoding method employed by the second encoding 
unit 105. 

As shown in Fig. 3, the additional information detecting 
apparatus 1200 includes a recording medium 12 01 having stored 
therein the image signals which have additional information, a 
data input unit 1202, and a decoding unit 1203. 

Read out signals reproduced from the recording medium 
1201 are supplied to the data input unit 12 02, and are 
supplied as reproduced image signals to the decoding unit 
1203. The decoding unit 1203 decodes the reproduced image 
signals. The decoding unit 1203 is so configured as to 
perform decoding processing corresponding to only the encoding 
method employed by the second encoding unit 105 using the same 
key 2. The decoding unit 1203 can detect only the additional 
information encoded by only the second encoding unit 105. 

In the additional information inserting apparatus 100, 4=¥t 
GQOc when the first encoding unit 104 and the second encoding 
unit 105 encode the same additional information, that is, 4z¥t 
GQOC — when the encoding method of the first encoding unit 104 
is different from that of the second encoding unit 105, and 
the two kinds of insertion pattern signals are multiplexed in 
the time divisional manner and superimposed %e — on the image 
signals, the original additional information can be detected 
when either — the additional information detecting apparatus 
200 or the additional information detecting apparatus 1200 
performs decoding processing corresponding to the encoding 
method thereof. 
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The two kinds of insertion pattern signals may be encoded 
such that they are orthogonal with each other^- or are not 
correlated with each other. For example, in — cQoc w hen the 

additional information is encoded using ^fefee Digital 

Watermarking, error detection can be prevented when the two 
kinds of insertion pattern signals are encoded such that they 
are orthogonal with each other or are not correlated with each 
other . 

The encoding method employed in the first encoding unit 

104 and second encoding unit 105 may be t^e Digital 

Watermarking, steganography , or encryption. 

OthQrwioo A lternatively , the encoding method may be that 
obtained by combining more than two kinds of encoding methods . 
The method for encoding additional information and inserting 
the encoded additional information into main information 
signals is disclosed in Japanese Laying-Open Patent H9-163341 
(United States Patent Number 5982997), United States Patent 
Number 5689587, and United States Patent Number 5848155. 

The additional information inserting apparatus 100 shown 
in Fig.l has arranged therein two encoding units^ or the first 
encoding unit 104 and the second encoding unit 105. On the 
other hand, three or more encoding units may be arranged so 
that three or more kinds of insertion pattern signals are 
multiplexed in the time divisional manner and superimposed 
on the image signals. 

At the side of detecting additional information, it is 
not necessarily required that — to employ a plurality of 
additional information detecting apparatuses such as tho£3Q — e# 
the additional information detecting apparatus 2 00 and the 
additional infoirmation detecting apparatus 1200, shown in 
Fig. 2 and Fig .3^ respectivelyT — ohould — be — employed . That is, 
the side of detecting additional information may be configured 
by employing either of the additional information detecting 
apparatuses . 
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In the additional information inserting apparatus 100, 
the additional information to be supplied to the first 
encoding unit 104 may be equal — fee — the same as that to be 
supplied to the second encoding unit 105. On the other hand, 
the additional information to be supplied to the first 
encoding unit 104 may be different from that to be supplied to 
the second encoding unit 105. OthGrvfioc Still further , the 
additional information to be supplied to the first encoding 
unit 104 may be partially different from that to be supplied 
to the second encoding unit 105, or both of the additional 
information may further have — added — thereto — another — include 
other information . 

In the time division multiplexing unit 106 and the 
superimposing unit 107, each additional information may be 
multiplexed and superimposed fee — on output image signals every 
frame, every multiple of two frames (24p) , every multiple of 
five fields (60i), at approximately 10 seconde ^ intervals , or 
longer . 

The main information signals fe^ — on which the additional 
information is superimposed is not restricted to the above- 
described image signals, and may be speech signals or text 
signals other than the image signals. The recording medium 
may be a disc-shaped medium such as a DVD, or may be a tape- 
shaped medium such as a DVHS or a DV. 

The additional information detecting apparatus may be a 
digital video recording apparatus such as a DVD, a DVHS or a 
DV. Otherwise, the additional information detecting apparatus 
may be configured by combining a personal computer and a 
medium drive mounted thereto. Furthermore, the main 

information signals and information signals having 
super impooed — thereto — the additional information superimposed 
thereon may be transmitted not via a recording medium but via 
a network or broadcasting waves - 
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The additional information may be copy controlling 
information related to data/contents being the m ain 
information, or may be other information. 

Fig. 4 shows a specified circuit diagram of a code 
modulating apparatus which is used in encoding and decoding 
processing of the additional information inserting apparatus 
100 shown in Fig.l and the additional information detecting 
apparatuses 200 and 1200 shown in Fig. 2 and Fig. 3. 

The code modulating apparatus shown in Fig. 4 is an 
example of an insertion pattern generating circuit which is 
employed in the Digital Watermarking technique. That is, a PN 
(Pseudorandom Noise) generating circuit generates insertion 
patterns corresponding to a_l V period of image signals using 
the spread spectrum so as to spread additional information. 
In detecting the additional information, the image signals are 
inversely spread. 

The code modulating apparatus shown in Fig. 4 is an 
example of tfee — an insertion pattern generating circuitT- in 
which 4095 chips are inserted in a_l V interval. 

When the clock rate is set to be 250 KHz, 1 period of the 
insertion patterns is calculated to be 4095/250 = 16.38 msec, 
which period can be within a 1 V interval (= 16.7 msec = 1/60 
sec) . Thus, phases of insertion pattern codes corresponding 
to a_l V period can be arranged by inputting a reset signal to 
an initialization signal every 1 V. So, synchronization of 
the insertion patterns is arranged, and insertion patterns for 
inspection are generated, thereby the additional information 
inserted into the image signals can be detected. The 1 V 
corresponds to 1 field of the image signals, or may correspond 
to 1 frame thereof. 

Fig. 5 shows another example of a block diagram of an 
additional information inserting apparatus 1100 according to 
the present invention. The additional information inserting 
apparatus 1100 encodes additional information signals using 
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two kinds of encoding methods to generate two kinds of 
insertion patterns^ afidr-multiplexes the insertion patterns and 
superimposes -fefee — roopcotivG — inocrtion — pattcrno — fee — them on 
image signals. 

The additional information inserting apparatus 100 shown 
in Fig.l multiplexes a plurality of insertion patterns in 

a time divisional manner, that is, superimposes different 

insertion patterns each of a predetermined interval fee — on 
image signals along the time direction thereof, while the 
additional information inserting apparatus 1100 shown in Fig. 5 
multiplexes insertion patterns and superimposes insertion 
patterns to on image signals using a multiplexing method other 
than the time division multiplexing. 

For cxamplc ln addition to time division multiplexing , the 
additional information inserting apparatus 1100 shown in Fig. 5 

can employ fehe spatial multiplexing, frequency division 

multiplexing, or overwriting multiplexing as a the 

multiplexing method othor than the time divioion multiplexing . 

— ppatial Spatial m ultiplexing is a multiplexing method 
which multiplexes insertion patterns to image signals by 
dividing a region such as each frame or each field of the 
image signals into two regions each with a large region or 
more regions . Othorwigc A lternatively , image signals may be 
divided into small blocks or pixels in performing fehe — spatial 
multiplexing . 

In employing fehe time division multiplexing, there 

coexist two kinds of intervals, that is, intervals in which 
the additional information detecting apparatus can detect 
additional information and those in which the additional 
information detecting apparatus cannot detect additional 
information. On the other hand, in employing fe-he — spatial 
multiplexing, even though the range where the insertion 
patterns are inserted is restricted, there cxioto — are no 
interval^ in which the insertion patterns cannot be detected. 
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Furthermore/ since a plurality of insertion patterns are 
inserted into 1 frame or 1 field by dividing the region 
thereof in performing ^fehe — spatial multiplexing, the time 
required for detection is caused to be extended in accordance 
with the number of multiplexed insertion patterns. 

f roquoncy Frequency division multiplexing is a 

multiplexing method which multiplexes insertion patterns to 
image signals by dividing the image signals into a plurality 
of frequency bands on coefficients of the frequency 
multiplexing Fourier transform or DCT (Discrete Cosine 
Transform) , and divisionally multiplexing insertion patterns 
to image signals in the divisional manner corresponding to the 
divided frequency bands. In employing -fefee — frequency division 
multiplexing, there will also be no interval in which the 
insertion patterns cannot be detected, while the time required 
for detection is caused to be extended as compared with the 
time division multiplexing. 

^?he overwriting Overwriting m ultiplexing is a 

multiplexing method which overwrites a plurality of insertion 
patterns to image signals, and this overwriting multiplexing 
can be combined with %he — frequency division multiplexing. In 
employing ^fehe — overwriting multiplexing, there will also be no 
interval where the insertion patterns cannot be detected. In 
performing the spatial multiplexing, key 1 and key 2 which are 
different from each other are used so as to enable detection 
of the insertion patterns inserted into the same region. When 
the key 1 and key 2 are used, the insertion patterns can be 
detected by utilizing non-relativity of the key 1 and key 2. 
Even though the key 1 is equal to the key 2, the insertion 
patterns can be detected from the same region by changing 
phases thereof at the time of inserting. Furthermore, the 
quality (image quality or tone quality) of the m ain 
information signals can be prevented from being deteriorated 
by overwriting the inverse of the insertion patterns to image 
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signals with the insertion level thereof reduced. 
Furthermore, the amount of information is not varied, while 
the time required for detection is caused to be extended. 

As shown in Fig. 5, the additional information inserting 
apparatus 1100 includes t*ie — a recording medium 101 of the 
image signal reproducing side, a data input unit 182, a first 
encoding unit 184, a second encoding unit 185, a multiplexing 
unit 186, and a superimposing unit 187. 

Read out signals reproduced from the recording medium 101 
are supplied to the data input unit 182, and are supplied as 
reproduced image signals to the superimposing unit 187. 

The additional information signals to be inserted into 
the image signals are supplied to the first encoding unit 184 
and the second encoding unit 185, respectively. 

The first encoding unit 18 4 has a key 1, and encodes the 
additional information signals using the key 1 in a first 
encoding method. Then, the first encoding unit 184 supplies 
the encoded signals as first insertion pattern signals to the 
multiplexing unit 186. 

The second encoding unit 185 has a key 2, and encodes the 
additional information signals using the key 2 in a second 
encoding methodr- which is different from that employed at the 
first encoding unit 184. Then, the second encoding unit 185 
supplies the encoded signals as second insertion pattern 
signals to the multiplexing unit 18 6. The key 1 may be equal 
to the key 2, or may be different from the key 2. 

The multiplexing unit 186 multiplexes the first insertion 
pattern signals supplied from the first encoding unit 184 and 
the second insertion pattern signals supplied from the second 
encoding unit 185, and supplies the multiplexed signals to the 
superimposing unit 187. In multiplexing a plurality of 

insertion patterns, the spatial multiplexing, frequency 

division multiplexing, or overwriting multiplexing can be 
employed. These multiplexing operations are similar to those 
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which had been already explained^ and the details thereof are 
omitted. 

The superimposing unit 187 composites the image signals 
read out from the recording medium 101 and the multiplexed 
insertion patterns, and outputs image signals having 
additional information. The output image signals will be 
recorded to ^^^e — a recording medium 151 of the image signal 
recording side which is different from the recording medium 
101, and which will be used in other apparatuses. The output 
image signals may be transmitted to other remote apparatuses 
via the network 152 • 

In detecting the additional information from the image 
signals to which the additional information is inserted by the 
additional information inserting apparatus 1100, the 
additional information detecting apparatus 200 and the 
additional information detecting apparatus 1200 shown in Fig. 2 
and Fig, 3, respectively, can be employed. 

As in the above, the present invention has been described 
concerning the best modes with reference to the accompanying 
drawings. On the other hand, the best modes may be modified 
or changed without departing from the spirit and scope of the 
present invention . 

In the above-described explanation, the additional 
information inserting apparatus encodes additional information 
signals using two kinds of encoding methods, aftd — ^multiplexes 
aftd — oupcrimpooco — the encoded additional information signals 
and superimposes them on ^ fe-e— output image signals supplied from 
a recording medium which has recorded therein the image 
signals. On the other hand, the present invention is not 
restricted to these embodiments. That is, main information 
signals such as speech signals or text signals other than tho 
image signals may be employed ^fee — in the present invention. 
Furthermore, the present invention can be employed not only to 
the case in which information signals are recorded 
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to/reproduced ^fee/from a recording medium^ but also to the case 
in which information signals are transmitted via a 
transmitting medium. 

That is, the best modes of the present invention have 
been disclosed as examples, and those examples should not be 
interpreted restrictedly . So as to interpret the summary of 
the present invention, refer to the following claims. 

Induo trial Applicability 

As — ifi — fe-he — above, — feh eThe additional information inserting 
apparatus according to the present invention encodes 
additional information signals using two or more kinds of 
encoding methods /encoding formats to generate two or more 
kinds of insertion patterns encoded by respective methods, afi€t 
multiplexes or multiplexes in the a time divisional manner the 
respective encoded insertion patterns and superimposes ^fehe 

roopcctivG oncodcd insertion pattcrno t ethem on main 

information signals. Thus, the additional information can be 
detected by decoding the encoded insertion patterns in 

accordance with at least cither one of the encoding 

methods /encoding formats . 

When the same additional information is encoded by a 
plurality of encoding means and inserted into the main 
information signals, even though one set of the additional 
information is deteriorated due to signal processing, attack, 
or other causes, the additional information can be detected 
correctly using the other set of the additional information. 

Furthermore, when a plurality of encoding 

methods /encoding formats are employed, even though the 
additional information is important information as seen from e 
vi-e wthe viewpoint of security, the security information cannot 
be completely erased, revised, or caused to be useless as long 
as all the encoding methods are not broken, which can ensure 
the protection of the copyright. 

430703_1.DOC 
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